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Abstract. How to find "best rational approximations" of maximal commutative sub- 
groups of GL(n,M)? In this paper we pose and make first steps in the study of this 
problem. It contains both classical problems of Diophantine and simultaneous approxi- 
mations as a particular subcases but in general is much wider. We prove estimates for 
n = 2 for both totaly real and complex cases and write the algorithm to construct best 
approximations of a fixed size. In addition we introduce a relation between best approxi- 
mations and sails of cones and interpret the result for totally real subgroups in geometric 
terms of sails. 
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Introduction: the problem and its relationships 

We pose and investigate a problem of approximation of maximal commutative sub- 
groups of GL{n, M) by rational subgroups, or more geometrically in other words a prob- 
lem of approximation of arbitrary simplicial cones in M" by rational simplicial cones. This 
problem is a natural multidimensional generalization of a problem on rational approxima- 
tions of real numbers that is contained in the case of n = 1. As a particular example it also 
contains a simultaneous approximation problem and closely related to multidimensional 
generalizations of continued fractions. The problem of approximation of real spectrum 
maximal commutative subgroups has much in common with the problem of approxima- 
tions of nondegenerate simplicial cones. This in particular allows to use methods dealing 
with multidimensional continued fractions. 

Mciximal commutative subgroups. We consider a Cartan subgroup of the group 
GL{n, ]R) or maximal abelian semisimple subgroups of GL{n, M) . Some times it is conve- 
nient to consider such subgroup as the set of all matrices, commuting with given semisim- 
ple element A G GL{n, M), i.e., the centralizer CcL{n,M.){A). The centralizer is commutative 
if and only if A has distinct eigenvalues. So we work with centralizers of "generic" ma- 
trices. For the field of real numbers not all Cartan subgroups are mutually conjugate: 
the general Cartan subgroup in ^//(n, R) has k one-dimensional and / two-dimensional 
minimal eigenspaces (where k+2l = n). Wc will study mainly the Cartan subgroups 
with only one-dimensional minimal eigenspaces, which we call "real Cartan subgroup", 
but all the definitions are extended to the general Cartan subgroups of GL{n, M) and can 
be extended to the case of the Cartan subgroup of GL{n, C) or more general semisimple 
groups. In that case all elements of the Cartan subgroup has real eigenvalues. 

We will use term "maximal commutative subgroup" or shortly MCRF, and denote the 
space of it as 

The space of simplicial cones. It is convenient to deal with geometric analog of 
MCRF-subgroups. Let us describe a relation of real maximal commutative subgroups 
and nondegenerate simplicial cones. 

A nondegenerate simplicial cone in is a conical convex hull of a set of n unordered 
linearly-independent vectors. Further we omit "nondegenerate" , since wc work only with 
nondegenerate cones. Together with any simplicial cone K one may study its symmetric 
with respect to origin cone —K. All further discussions, constructions, notions, and 
statements are invariant with respect to the map x i— > —x of R", and hence they all deal 
with both cones K and its symmetric one —K. Therefore, we identify the cones K and 
—K and define Simpln as a space of pairs of symmetric cones. 

There exists a natural (2"~^)-folded covering of the space €n of all maximal commutative 
subgroups by the space Simpln' 

Simpln ^ 

the cones map to the subalgebras whose eigendirections are the extremal rays of the cones. 
So for any element of Simpln we have a maximal commutative subgroups. 
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Therefore, approximation problems, which we discuss below and which are local prob- 
lems, can be studied in terms of the groups as well as in terms of simplicial cones. 

A space Simpln of all simplicial cones in can be defined directly with coordinates of 
cones generators, nevertheless it is very important to understand this space as a homoge- 
neous space of the group GL{n, M) in the following way. 

Consider a group GLlujM^jjn > 1 of all linear invertible transformations in with a 
fixed basis. Take Dn — the subgroup of the diagonal matrices in the chosen basis which 
have positive numbers on the diagonal, i.e. a positive part of the corresponding Cartan 
subgroup or connected component of the unity of that subgroup. The elements of this 
subgroup leaves invariant each of the 2" of coordinate cones. The left homogeneous space 
GL{n, M.)/Dn can be considered as a space of all connected parts of the Cartan subgroups 
of the group GL{n,M.). To get a cone (or actually a pair of symmetric cones K and —K) 
we should add a symmetric group of coordinate permutations Sn (Weil group) which is 
also contained in the normalizer of D^- Denote by the skew- product Sn X -D„ of the 
symmetric group and the subgroup of diagonal matrices. 

A homogeneous space 

GL{n,R)/Dn 

of left conjugacy classes in GL{n,M.),n > 1 with respect to the subgroup Dn is naturally 
identified with the space of all {pairs of) nondegenerate simplicial cones Simpln- 

Indeed, the subgroup of GL{n,M.) preserving the positive coordinate cone M" as well 
as its reflection coincides with the group and GL{n,M.) transitively acts on Simpln- 

Notice that it is sometimes convenient to take the group SL{n,M.) instead of GL(n, M) 
(factoring the last by the subgroups of positive scalar matrices and taking Dn as the 
subgroup of positive diagonal matrices with unit determinant in SL{n,M.): 

Simpln = SL{n, R) n SL{n, M)} 

A homogeneous space Simpln, n > 1 is not compact. This space admits a transitive 
right action of the whole group GL{n, M) and it possess an essential absolutely continuous 
measure that is quasihomogeneous with respect of the action. This measure is called 
Mobius measure, it was studied in [18]. We are mostly interested in the actions of SL{n, Z) 
and SL{n, Q) on the space Simpln but not in the action of the whole group GL{n, IR), n > 
1. These actions are ergodic. 

Definition 0.1. Consider a simplicial cone C e Simpln- The boundary of the convex 
hall of the integer points in this cone without an origin, i.e. 

a(conv|cnZ"\ (0,...,0)}), 

is called the sail of the simplicial cone- 

The space of the simplicial cones could be identified with the space of the sails of 
simplicial cones. 
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Remark. Note that one can consider the sail for other convex bodies, for instance of the 
interiors of conies. 

For the simplest case of n = 2 a simplicial cone is a convex angle between two rays on 
the plane, and the space Simpl2 of all cones is a two dimensional torus without a diagonal 
modulo the involution: {S^ x 5"^ \ Diag}/ ~, where Diag is the diagonal in x 
and ?a is a factorization: {x, y) ~ {y, x). Here the points of the circles are the oriented 
lines in that contains critical rays of the angles, and quasiinvariant measure is the 
Lebesque measure. Actually Simpl2 is a Mobius strip without a boundary or equivalently 
a punctured projective plane. The geometry of the corresponding cone includes a part 
of the classical theory of continuous fraction. The sail for n = 2 is the boundary of 
noncompact convex polygon. The two-dimensional case is tightly connected with classical 
continued fractions (see in Section 2). 

The problem of approximations. The described relation between simplicial cones and 
real spectrum (i.e. having real eigenvalues, see further) maximal commutative subgroups 
in GL(n, R) preserving the corresponding cones is a covering (up to an identification of 
the cone and its central symmetrical image). Therefore approximations of such subgroups 

and approximations of simplicial cones (we speak about this further) are the same up to 
the lifting. Recall that we have fixed a system of coordinates in R*^, and hence we have a 
special coordinate simplicial cone Kq = R" (a hyperoctant). 

Definition 0.2. A rational simplicial cone (or respectively a rational commutative subgroup) 
is a cone (a subgroup) whose all extremal rays (eigen-directions) contains points distinct 
to the origin with all rational coordinates, actually this implies the existence of points 
with all integer coordinates as well. 

A simplicial cone (maximal commutative subgroup) is called algebraic if there exists a 
matrix g G SL{n, Z) with distinct eigenvalues whose eigen-directions generates this cone 
(respectively integer matrix whose centralizer in SL{n, R) coincides with this subgroup). 

It is clear that the rational cones form the orbit of the coordinate cone Kq with respect 
to the group SL{n, Q). 

An example of an algebraic simplicial cone is the conical convex hull of the two eigen- 
vectors of the Fibonacci matrix: 



Definition 0.3. Consider some cone C E Simpln and take nonzero linear forms Li,. . .,L. 
that annulates the hyperfaces of the cone. A Markoff-Davenport form is 



where A(Li, . . . , L„) is the volume of the parallelepiped spanned by ior k — 1, . . . ,n 
in the dual space. 




n 



n {Lk{xi,... 
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This form is defined by a cone uniquely up to a sign. Now having Markoff-Davenport 
form $ one can define distances between two cones. For two cones Ci and C2 consider 
two forms 

$Ci (v) + (v) and (v) - ^c^ (v) ■ 

Take the maximal absolute values of the coefficients of these forms separately, the minimal 
of them would be the distance between Ci and C2. Further in Subsection 1.1 we define 
Markoff-Davenport form in a more general situation. 

Now we are ready to formulate the main problem of approximations: 
For a given simplicial cone {or maximal commutative subgroup of SL{n,R)) 
find a rational simplicial cone {rational maximal commutative real subgroup) 
that for a chosen Markoff-Davenport metric is the closest rational simplicial 

cone {subgroup) in some fixed class of rational cones {subgroups) . 

Such classes of rational cones can chosen to be finite classes including only cones having 
fixed "sizes" of integer points on their rays (for more information see below in Section 1). 

First of all the approximations problem by rational simplicial cones (subgroup) must 
be considered for algebraic cones (subgroups). The most intriguing things arc connected 
with generalization of the beautiful theory of Markoff-Lagrange spectra [31] and Markoff- 
Davenport n-ary forms [10]. 

Relations with theory of multidimensional continued fractions. The problem 
on approximation of commutative subgroups or simplicial cones formulated above and 
studied in this work is intimately connected with the theory of multidimensional continued 
fractions but does not reduce to that. 

The recent work by V. 1. Arnold [2] and the following works by him [4], E. 1. Korkina [26], 
G. Lachaud [29], J.-O. Mussafir [33], Karpenkov [14], etc., revived the interest to one of 
classical generalizations of continued fractions theory, considered for the first time by 
F. Klein in [23]. From geometrical point of view the generalization deals with sails. The 
classical theory of ordinary continued fractions i.e. theory of Gauss transformations in 
algcbro-dynamical terms related to the case n = 2 was made by R. L. Adler and L. Flatto 
in [1]. M. L. Kontsevich, Yu. M. Suhov in [24] made an improved version admitting an 
extension to multidimensional case. In the work [24] the authors considered the following 
approach to these questions: to study the homogeneous space SL{n,'R)/ SL{n,7j), i.e. 
the space of lattices in SL{n,M), and the action of the Cartan subgroup D„ on it. For 
n = 2 this action is reduced to the action of the group M} and as it is known from [1] it 
is a special suspension over the Gauss automorphism that lies in a definition of continued 
fractions. 

One can suppose that the solution of the approximation problem reduced to the geom- 
etry of the sails in the following sense: in order to find the best approximation of the cone 
(equivalently maximal commutative subgroup) one must find the appropriate basis of the 
vectors which belong to the vertices of the sail of this cone or adjacent cone. Up to now 
this is an open question. The experiments show that it could be not always the case (see 
for instance in Example 3.11). 
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Let US show connections of our problem with this geometry. First of all the space 
Simpln as we had mentioned can be interpreted as the space of sails of simplicial cones. 
Let us compare our approach to the geometry of sails with [24]. 

One can think of dynamical systems as of triples: (a space, a group action, an invariant 
or quasiinvariant measure). Then in [24] the authors study the dynamical system 

{SL{n,R)/SL{n,Z), D„, //„}. 

i.e. in our terms it is multidimensional suspension (time here is a Cartan subgroup) in a 
given or an arbitrary cone. 

Our approach to theory of sails is in some sense dual to the approach of [24]. We 
consider another dynamical system, namely, the action of a discrete (noncommutative) 
group SL{n, Z) (or SL{n, Q)) in the space of sails (or equivalently simplicial cones): 

{Simplni^SL{n,R)/Dn), SL{n,Z), //J. 

Roughly speaking the "time" and the subgroup defining the homogeneous space has been 
transposed. 

Both approaches have their own advantages and limitations. However the main aim of 
the current work is not in studying of multidimensional sails, their statistics and other 
properties, but in their applications to approximations. 

More about geometry of sails. The geometry of sails is very interesting by itself. One 
of the essential subjects here is a statistical analysis of their geometric characteristics with 
respect to the measure on the space of the sails Simpln- For instance, what is the measure 
of sails with given properties: say with given number of faces of some given combinatorial 
type (see [24], [5], [6], [15], [18]). This would generalize Gauss-Kuzmin theorem (see 
in [28]) and some others for ordinary continued fractions. The work in this direction has 
just started and it is not much known now, first theorems on this subject can be found 
in [18]. 

Faces of different dimensions of a sail were studied in [29], [33], [13], [25], [17]. In alge- 
braic cases all faces are polyhedra. It is also natural to consider the sails in the adjacent 
hyperoctants. The important problem here is to study the condition for a polygonal sur- 
face to be a sail form some cone. This problem was posed by V. L Arnold and was studied 
in several papers ([3], [4], [14], [16], [17], [20], [26], [27] [29], [33]). In [37] H. Tsuchihashi 
showed the relation between sails of cones and cusp singularities, introducing a new appli- 
cation to toric geometry. This relation is studied in detail in [19] for the two-dimensional 
case. 

Actually in the study of Simpln the other multidimensional generalizations of contin- 
ued fractions can be useful. This in particular includes the considered before convex- 
geometric ([23], [4], [26], [29], [14]) local minima type ([32], [7]), Voronoy ([39], [9]), and 
algorithmic ([34], [35]) generalizations of continued fractions. 

Connections with limit shape problems. Another link of the approximation problem 
is with so called limit shape problems. We want only to emphasize here that the problems 
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like limit shape problems about Young diagrams or convex lattice polygons (see [38]) can 
be considered in the simplicial cones (instead of traditional posing in the hyperoctant Z+), 
and in this case the rational approximation of the cone becomes an important argument. 
We hope to consider this in the appropriate place. 

Description of obtained results. Let us briefly describe the results of this work. Ap- 
parently the problem of approximations of arbitrary commutative subgroups in SL{n, M) 
was never stated in such generality. By the problem of approximation we mean the prob- 
lem of finding of best approximation of a simplicial cone by rational cones (similar to 
the classical problem on best approximations of real numbers by rational numbers) . This 
problem is very complicated already in the case of n = 2. That is also applied even to the 
algebraic cones. We give several estimates that suggest an idea that best approximations 
are not always related to sails or to sails of adjacent cones (see also in Example 3.11). 

First, we show that the classical case of approximations of real numbers by rational 
numbers is really one of particular cases of the proposed new approximation model. In 
addition we also indicate that simultaneous approximations are also covered by our ap- 
proach. 

Further we work in general case of n = 2. We give upper and lower estimates for the 
discrepancy between best approximations and original simplicial cones in the following 
important case (Theorem 3.1): let q;i,q;2 £ R both have infinite continued fractions with 

bounded elements, consider a simplicial cone bounded by two lines y = ai and y = a2, 
then the growth rate of the best approximation of size N is bounded by Ci/N"^ and C2/N'^ 
while N tends to infinity. Then we translate this statement to the language of sails 
and their generahzations (Theorem 3.8) and finally show an algorithm to construct best 
approximations of a fixed size. 

Remark. In this paper we work in a slightly extended way including commutative sub- 
groups of SL{n, M) having complex conjugate eigenvectors as well. This is the main reason 
for our choice to use terminology of commutative subgroups instead of simplicial cones 
(that are convenient only for the totally real case). 

We conclude the paper with several examples of approximations in the three-dimensional 
case, coming from simultaneous approximations. 

The paper is organized as follows. In Section 1 we give basic notions and definitions of 
maximal subgroup approximation theory. We introduce sizes and discrepancies for the 

subgroups and define the notion of "best approximations" in our context. In Section 2 
we briefiy show how the classical theory of Diophantine approximations is embedded into 
theory of subgroup approximations. 

Further we make first steps to study a general two-dimensional case. It is rather compli- 
cated since we need to approximate an object defined by four entries of 2 x 2 matrices that 
vary. Hence this case is comparable with a general case of simultaneous approximations 
of vectors in M^. Nevertheless it is simpler to find the best approximations in the case of 
subgroups, especially in special algebraic case when a certain periodicity of approxima- 
tions take place. In Section 3 we write estimates for the quality of best approximations for 



8 



O. N. KARPENKOV, A. M. VERSHIK 



both hyperbolic and non-hyperbohc cases of rays whose continued fractions has bounded 
elements. This in particular includes an algebraic case. We also show geometric origins 
of the bounds in terms of continued fractions for the hyperbolic algebraic case. 

Finally in Section 4 we study in a couple examples the case of simultaneous approxi- 
mations of vectors in in the frames of subgroup approximations. We test two algebraic 
examples coming from totally real and non-totally real cases. 



In this section we give general definitions and formulate basic concepts of maximal 
commutative subgroups approximations. We recall a definition of a Markoff-Davenport 
form in Subsection 1.1. Further in Subsection 1.2 we define rational subgroups and choose 
"size" for them. We define the distance function (discrepancy) between two subgroups in 
Subsection 1.3. 

As we have already mentioned we will continue with terminology of maximal commu- 
tative subgroups. In case when we deal with real spectra subgroups the statements can 
be directly translated to the case of simplicial cones. 

1.1. Regular subgroups and Markoff-Davenport forms. Consider a real space 
and fix some coordinate basis in it. A real operator is called regular if all its eigenvalues 
are distinct (but not necessary real). A maximal commutative subgroup of GL{n,'R) is 
said to be regular, or MCRS-group for short, if it contains regular operators. 

We say that a one-dimensional complex space is an eigenspace of an MCRF-group if it 
is an eigenspace of one of its regular operators. Actually any two regular operators of the 
same MCRS-group have the same eigenspaces, therefore each MCRF-group has exactly n 
distinct eigenspaces. 

Consider an arbitrary MCRS-group A and denote its eigenspaces by /i, . . . , /„. Denote 
by Li a nonzero linear form over C" that attains zero values at all vectors of the complex 
lines Ij for j ^ i. Let A(Li, . . . , L„) be the determinant of the matrix having in the A;-th 
column the coefficients of the form Lk ior k — 1, . . . ,n in the dual basis. 

Definition 1.1. We say that the form 



1. Rational approximations of MCRF-groups 



n 



n {Lk{xi,...,Xn)) 



k=l 



A{Li,...,Ln) 



is the Markoff-Davenport form for the MCRS-group A and denote it by 



Example 1.2. Consider an MCRS-group containing a Fibonacci operator 




Fibonacci operator has two eigenlines 

y — —9x 



and y — ^x, 
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where 6 is the golden ration So the Markoff-Davenport form of Fibonacci operator 

is 



A Markoff-Davenport form is uniquely defined by an MCRS-group up to a sign, since 
the linear forms Lj are uniquely defined by the MCRS-group up to multiplication by a 
scalar and permutations. By definition any MCRS-group contains a real operator with 
distinct roots, therefore all the coefficients of the Markoff-Davenport form are real. 

Remark 1.3. The minima of the absolute values of such forms on the integer lattice were 
studied by A. Markoff in [31] for two-dimensional case, and further by H. Davenport in [10], 
[11], and [12] for three-dimensional totally real case. A few three-dimensional totally real 
examples were exhoustively studied by A. D. Bryuno, V. I. Parusnikov (see for instance 
in [8]). The first steps in general multidimensional case were made in paper [21]. 

1.2. Rational subgroups and their sizes. Wc start with the following definition. 

Definition 1.4. An MCRS-group A is called rational if all its eigenspaces contain Gauss- 
ian vectors, i. e. vectors whose coordinates are of type a-\- lb for integers a and b, where 
P = —1. Denote the set of all rational MCRS- groups of dimension n by Rat„. 

Example 1.5. The following two operators 



represents rational MCRS- groups (denote them by Ai and An) with real and complex 
conjugate eigen-directions. 

For a complex vector v — {ai+Ibi, . . . , Un+Ibn) denote by \v\ the norm 



A Gaussian vector is said to be primitive if all its coordinates are relatively prime. 

Suppose that a complex one-dimensional space has Gaussian vectors, then the minimal 
value of the norm | * | for the Gaussian vectors is attained at primitive Gaussian vectors. 

Definition 1.6. Consider a rational MCRS-group A. Let Zi, be the eigenspaces of 

A. The size of ^ is a real number 





with eigenvectors (1, 2) and (1, —2) 



with eigenvectors (/, 1) and (—7,1), 




max 

i=l,...,n 



fi| 1^;^ - is a primitive Gaussian vector in Zj}, 



we denote it by ^{A). 



The sizes of operators in Example 1.5 are 1 and 2 respectively. 
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1.3. Discrepancy functional and approximation model. We are focused mostly on 
the following approximation problem: how to approximate an MCRS-group by rational 

MCRS-groups {or even by a certain subset of rational MCRS-groups)l 

Let us first define a natural distance between MCRF-groups. Let Ai and A2 be two 
MCRS-groups. Consider the following two symmetric bilinear forms 

^aAv) + ^A2{v) and ^j^^{v)-<^j^^{v) 

for vectors in M". Take the maximal absolute values of the coefficients of these forms 
(separately) . The minimal of these two maximal values we consider as a distance between 
Ai and A2-I we call it discrepancy and denote by ^2)- 

Let us calculate the discrepancy between the MCRS-groups of Example 1.5. We have 

therefore Ai) = 

Definition 1.7. Let Vt C Rat„ for a fixed n. The problem of best approximations of an 
MCRS-group A by MCRS-groups in VL is as follows. For a given positive integer N find 
a rational MCRS-group An inVl with size not exceeding N such that 

p(A^iv) = min{p(AA)|A G VL,u{A:) < N}. 

Remark 1.8. There are another important classes of MCRS-groups that contain matrices of 
GL{n, Z) and GL{n, Q) respectively. The MCRS-group is said to be algebraic if it contains 
regular operators of GL{n, Z). It is natural to consider approximations of MCRS-groups 
by algebraic MCRS-groups, and approximations of algebraic MCRS-groups by rational 
MCRS-groups. 



y y — 4x 



± 



2. DiOPHANTINE APPROXIMATIONS AND MCRS-GROUP APPROXIMATIONS 

A classical problem of approximating real numbers by rational numbers is a particular 
case of the problem of best approximations of MCRS-groups. 

For a real a denote by A[a] an MCRS-group of GL(2,M) defined by the two spaces 
X — Q and y = ax. Consider any two MCRS-groups A[ai] and A[a2\ with positive ai and 
a2 and calculate a discrepancy between them. 

_^ _^ x(y — aix) x(y — a2x) n 

^Alai] - ^Ala2] = = ("2 - ai)X 

x(y — aix) x(y — a2x) ^ , , n 

^A[a,] + ^A[a,] = ^ ^ + ^ ^ = 2xy - (cVs + ai)x^ 

Since ai > and q;2 > we have 

p(.4[q;i],v4.[q;2]) = l^i - a2\- 
Denote by ^ a subset of all A[a] for rational a in the segment [0, 1]. 
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For any couple of relatively prime integers (m, n) satisfying < ^ < 1 we have 



A classical problem of approximations of real numbers by rational numbers having 
bounded denominators in our terminology is as follows. 

Theorem 2.1. Consider a real number a, < a < 1. Let [0, oi, . . .] (or [0, oi, . . . , Ofe]) 
be an ordinary infinite (finite) continued fraction for a. Then the set of best approx- 
imations consists of MCRS-groups A[m/n] for m/n = [0, ai, . . . , a^-i, a/] where I = 
1,2,... {In case of finite continued fraction we additionally have A[m/n] for m/n = 
[0,ai, . . . ,afe_i,afc-l]). □ 



In this section we prove estimates on the quality of best approximations for MCRS- 
groups whose eigen-directions are expressed by continued fractions with bounded denom- 
inators. Wc study separately the cases of hyperbolic and non-hyperbolic MCRS-groups. 
Especially we study geometric interpretation of the bounds in turms of geometric contin- 
ued fractions for the algebraic hyperbolic MCRS-groups. 

3.1. Hyperbolic case. An MCRS-group is called hyperbolic if it contains a hyperbolic 
operator (whose all eigenvalues are all real and pairwise distinct). 

3.1.1. Lagrange estimates for a special case. In this subsection we prove an analog of 
Lagrange theorem on the approximation rate for an MCRS-groups that has eigenspaces 
defined hj y = aix and y — a-iX with bounded elements of the continued fractions for a\ 
and (12- In particular this includes all algebraic MCRS-groups. Here we do not consider 
the case when one of the eigenspaces is a; = 0, this case was partially studied in Section 2. 

Theorem 3.1. Let a\ and a2 be real numbers having infinite continued fractions with 
bounded elements. Consider an MCRS-group A with eigenspaces y = a\X and y = a^x. 
Then there exist positive constants Ci and C2 such that for any positive integer N the best 
approximation An in^ satisfies 



We will start the proof with the following two lemmas. 

Denote by As^^s^ the MCRS-group defined by the lines y — {ai-\- 5i)x for i — 1,2. 

Lemma 3.2. Consider a positive real number Si such than Si < l/\ai — a2\. Suppose 
that p{A,Asi,S2) < £i then 




3. General approximations in two-dimensional case 




l^il < 



(l+|ai|)(ai-a2)^ 
|a;2|(l-£l|a;i-a2|) 



and 



S2\ < 



(l+|a2|)(ai-a2)^ 
|ai|(l-£i|ai-a2|) 
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Proof. Let us remind that the Markoff-Davenport form of Asi,s2 is 

{y-{ai + S,)x){y-{a2 + S2)x) 

Consider the absolute values of the coefficients at and at xy for the difference of 
Markoff-Davenport forms for the MCRS-groups A and Asi,s2- By the conditions of the 
lemma these coefficients are less then Si. 



62 - Si 



(tti — a2){ai — a2 + 61 — 62) 
From the first inequality we have: 



< £1 and 



ai52 — 0261 



(«! — q;2)(q!i — a2 + Si — S2) 



< £1. 



\Si - S2\ < 



1 — £i|q;i — a2 



The second inequality implies: 
l<^i|< 

and therefore 
l<^i| < 



(cti — q;2)(ci;i — a2 + Si - 


-S2)\£l+ 


ai{Si - ^2) 




a2 





tti hi i r^i 

I ^ I 1— £l|ai— a:2| 



|a2| 



(1 + -^2)^ 
|a2|(l - - "2!) 



The inequality for S2 is obtained in the same way. □ 
Lemma 3.3. Let 82 he a positive real number. Suppose \Si\ < S2 and \S2\ < £2, then 

max ^2, 2(|q;i| + |q;2|), aj+a^ + |Q;i-a2|£2^ 



p{A,As,,s2) < 



-£2- 



{\ai - a2\){\ai - a2\ + le-^ 

Proof. The statement of lemma follows directly form the estimate of the coefficients for 
the difference of Markoff-Davenport forms for the MCRS-groups A and A&^^^^. □ 

Proof of Theorem 3.1. Let us start with the first inequality. Let ai = [oq, ai, . . .], and 
]. Without loss of generality we assume that N > uq. Suppose k is 
the maximal positive integer for which < N and Uk < N. Then we have 



mm 



m 



ai — 



\m\<N^ \'n\<N ) > 
1 



ai — 



> 



1 



nk+i(n 



> 



k+i + nk+2) 



> 



(ojk+i + l)nfe((afe+i + l)nk + {ak+i + l){ak+2 + ^W) (ofe+i + 1)^(0^+2 + 2) A^^ • 

For the second and the third inequalities we refer to [22]. 

The same calculations are valid for a2. Hence we get Ci from Lemma 3.2. 

Now we prove the second inequality. 



ai 



rrik 
rik 



< 



rikTik+i 



Ofc+l + 1 (Ofc+i + 1) . , i\2\ 

< ^ < — max (1, [ai + 1) ) . 



n 



k+l 



7V2 
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The first inequafity is classical and can be found in [22]. We take maximum in the last 
inequality for the case of ruk+i > N and Uk+i < N. From conditions of the theorem the 
set of aj's is bounded. Therefore, there exists a constant i such that for any N there 
exists an approximation of ai of quality smaller than C2^i/N'^. 

The same holds for a2- Therefore, we can apply Lemma 3.3 in order to obtain the 
constant C2. □ 

Let us say a few words about the case of unbounded elements of continued fractions for 
«j. Take any positive e. If the elements of a continued fraction (say for ai) are growing 
fast enough than there exists a sequence Ni for which the approximations are of a 
quality -jj^^r^. We show this in the following example. 

Example 3.4. Let M be a positive integer. Consider ai = [oq, ai, . . .], such that oq = 1, 
a„ = {nk-i)^-\ Denote ^ = [oq, • • • Let 03 = 0. Take Nk = Then there 

exists a positive constant C such that for any integer i we have 

C 



Proof. For any i we have 



Therefore, the best approximation with denominator and numerator less than Nk is not 
better than 



rrik 
ai 

rik 



1 1 2^+1/^ 

> : > ^r-^^ r > 



nk{nk+i + rik) ' n^_^^{nk+i + n^) 7^1+ Vm • 

Now we apply Lemma 3.2 to complete the proof. □ 

We suspect the existence of badly approximable MCRS-group A and a constant C such 
that there are only finitely many solutions N of the following equation 

p{A,An) < ^, 

like in the case of simultaneous approximations of vectors in (see for instance in [30]). 

3.1.2. Periodic sails and best approximations in algebraic case. Let us show one relation 
between classical geometry of numbers (for example see in [4]) and best simultaneous 
approximations. 

First we recall the notion of sails. Consider an arbitrary cone C in with vertex at 
the origin and boundary rays ri and r2. We also suppose that the angle between ri and 
r2 is non-zero and less than tt. Denote the set of all integer points in the closure of the 
cone except the origin by /ri,r-2- The sail of this cone is the boundary of the convex hull 
of Iri,r2- It is homeomorphic to a line and contains rays in case of rj has an integer point 
distinct to the origin. 
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Definition 3.5. Define inductively the n-sail for the cone C. 

— let 1-sail be the sail of C. 

— suppose all /c-sails for k < ko are defined then let ko-sail be 

ko-l 

9^conv ^/j.i,r-2 \ U 

k=l 

where conv(M) denote the convex hull of M. 

The /c-sails have the following interesting property. 

Proposition 3.6. Consider a cone C. The k-sail of C is homothetic to the 1-sail of C 
and the coefficient of homothety is k. □ 

Now consider an arbitrary MCRS-group. Let li and I2 be the two eigenlines for all the 
operators of MCRS-group. The union of all four /c-sails for the cones defined by the lines 
li and I2 is a k-geometric continued fraction of the MCRS-group. 

Further we proceed with an algebraic case. So a hyperbolic MCRS-group A contains an 
GL{2, Z)-operator with distinct eigenvalues. In this case the mentioned operator acts on 
a /c-geometric continued fraction (for any k) as a transitive shift. In addition the values 
of the function 

$^(m, n), for m,n & 'Z, 

are contained in the set ctZ where the value a is attained at some point of the 1-geometric 
continued fraction. The value a — a{A) is an essential characteristic of A, it is sometimes 
called Markoff minima of the form $,4. 

Lemma 3.7. Let an integer point {m, n) be in the k-geometric continued fraction of A. 
Then 

|$^(m,n)| > ka. 

Proof. We use induction. 

The statement clearly holds for k = 1. 

Suppose the statement holds for k = ko let us prove it for k = ko + 1- From the 
step of induction we have the following: for any cone the convex hull of real points 
[^^(ct) ^)l = ^oo^ contains the /co-sail of the cone. From the other hand all integer points 
with |$_4(r/i. n)\ = k^a (if any) are on the boundary of this convex hull. Hence all of them 
are in /cQ-sail, and thus they are not contained in (A;o+l)-sail. □ 

Theorem 3.8. Let A be an algebraic MCRS-group. Then there exists a positive constants 

C such that for any positive integer N the following holds. Let the best approximation 
An E Q be defined by primitive vectors Vi and V2 contained in ki- and k2-geometric 
continued fractions respectively, then ki, k2 < C . 

Proof. By Lemma 3.7 it is sufficient to prove that the set of values of |$^(vj)| is bounded. 
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Let A has eigenlines y — aiX, i — 1,2. Notice that 

(m — ain){m — a2n) 
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m 




m — 




ai 




n 




n 




cci — 



|$^(m,n) 

cci — a2 

Let v\ — (xi, yi). By Lemma 3.2 (without loss of generahty we suppose that vi corresponds 
to 5i in the lemma) the first multiplicative is bounded by C /N"^ for some constant C that 
does not depend on N . 
Hence, 



\^A{xuyi)\<C 



£1 
2/1 



^2 



N"^ «! — a2 



< C 



^2 



tti — a2 



Finally, the last expression is uniformly bounded. The same holds for V2. 
Therefore, the set of values of is bounded. 



□ 



Conjecture 1. We conjecture that for almost all N the vectors vi and V2 defining 
are in 1-geometric continued fraction. 

3.1.3. Technique of calculation of best approximations in the hyperbolic case. In this sub- 
section we show a general technique of calculation of best approximations for an arbitrary 
MCRS-group A with eigenspaces y — aix and y — a2X for distinct real numbers ai and 
a2. 

Proposition 3.9. Let m and n be two integers. Suppose \ai — ^| < £3 (or \a2 — ^\ < £3 

respectively) , then the following holds: 



CKi — 



m 

n 



> 









$^(m,n)| 




- a2 


+ 


£3 





a2 — 



m 
n 



> 



1 



|$^(m,n) 



Fi - "2! + £3 



Proof. Wc have 
1 



Oil 



m 
n I 



,m — aim — 



1 \m—ain\(m—a2n) 
m—a2n 



\ai—a2\ 



> 



\ai-a2\ |^yi("t,n) 
|ai— a2|+£3 



□ 



\ai-a2+{^-ai 

The same holds for the case of the approximations of a2. 
Procedure of best approximation calculation. 

1) . Find best Diophantine approximations of ai and 02 using continued fractions in 
the square N x N. Suppose for ctj it is rrii/ni, and the following best approximation is 
m'Jn'i. _ 

2) . Consider now the MCRS-group A with invariant hues y = ^x. By Lemma 3.3 we 

get an upper bound for p{A,A) (where £2 — max(l/(nin'i), l/(n2n2))). 

3) . Now having the estimate for discrepancy we use Lemma 3.2 to get estimates Ci 
and C2 for — and |ct2 — ^| for the best approximation of A with rays y — ^x and 
y = —x. 

^>a(jhM fori 



4). By Proposition 3.9 wc write an estimate for 



1,2. 



5). Finally wc compare the discrepancies for all MCRS-groups that satisfies the esti- 
mates for '^•^^i"^''' obtained in 4). 
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Example 3.10. Consider an MCRS-group containing Fibonacci matrix: 

1 

1 1 

Denote by F„ the n-th Fibonacci number. 
Consider any integer N > 100. 

1). Consider a positive integer k such that Fk < N < Fk+i and choose an approximation 
A with eigenspaces Fk-vy — FkX = and Fj-y + Fk-ix = 0. Then 



Fk 

tti — - — 



< l/(Ffc_iFfc), 



fc-i 

2). So, £2 = l/{Fk-iFk) < 1/(55 • 89). Therefore, 



< l/{FkFk+,) 



max (2, 2^5, 3 + a/5/4895) ^ ^^5 (89/55)^ 3.79 

+ 4895 " ^ " ^ + 4895 

3) . Hence, by Lemma 3.2 we get (si < 3.79/1002): 

\S,\ < ^ and \S2\ < '-1^. 

4) . The estimates for ^-^^^'^^^ and ^■^^^''^^^ for the corresponding rays of best approxi- 
mation are as follows. 

|^^(mi,ni)| 80.65 |^^(m2,n2)| 18.99 



5). Notice that the number of approximations whose discrepancies we compare in 
this step is bounded by some constant not depending on N. We have completed the 
computations for N — 10^, the answer in this case is the matrix with eigenspaces: F29y — 
F30X = and Fsoy + F29X = 0. 

We conjecture that for the Fibonacci matrix we always get the best approximation with 
eigenspaces Fk-iy — FkX = and Fky + Fk-ix = 0. 

We conclude this subsection with an example showing that the continued fractions do 
not always give best approximations. 

Example 3.11. Consider an operator A with eigenvectors: 

^;i = (l,2) and V2^{2,3), 

and the corresponding maximal subgroup A. Then there are four different best approxi- 
mations of size 1, they have invariant lines defined by the following couples of vectors: 

(wi = (1,0), W2 = (1,1)), {wi = (1,0), W2 = (1,-1)), 

(wi = (l,0),^i;2 = (0,1)), and (wi = (0, 1), w;2 = (1, 1)) . 
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(the discrepancy between A and any of them equals 6). The continued fraction (or the 
union of sails) of A contains only four integer points 

(1,2), (2,3), (-1,-2), and (-2,-3). 

Therefore the invariant lines of all four best approximations do not contain vectors of the 
sail of A. 

Remark 3.12. Actually, for a generic MCRS-group the best approximation of any size 
> is unique. In the previous example we have four best approximations since we are 
approximating MCRS-group defined by vectors with integer coefficients. 

3.2. Non- hyperbolic case. Now we prove similar statements for the complex case. 

3.2.1. Lagrange estimates for a special case. In this subsection we prove an analog of 
Lagrange theorem on the approximation rate for an MCRS-groups that has complex 

conjugate eigenspaces defined hj y = {a + ip)x and y = {a — ip)x with bounded elements 
of the continued fractions for a and j3. In particular this includes all complex algebraic 
MCRS-groups. 

Theorem 3.13. Let a and (3 he real numbers having infinite continued fractions with 
bounded elements. Consider an MCRS-group A with eigenspaces y = {a + I(5)x and 
y — {a — ipi)x. Then there exist positive constants Ci and C2 such that for any positive 
integer N the best approximation An in satisfies 

C C 
^<p(A,An)<^. 

Wc will start the proof with the following two lemmas. 

Denote by Asi,s2 the MCRS-group defined by the lines y = ((a -|- di) ± I{(3 + S2))x for 
i = l,2. 

Lemma 3.14. Consider a positive real number Si such than Z\ < 2{i+\i3\) ■ Suppose that 
p{A,As^,S2) < si then 



I c I 2\a-l3\f3^ 



and 



2(l+|/3| + |a-/3|)/32 ^ 
^ |a-^|-2£i|^|(l+|/3|)^l- 



Proof. Consider the absolute values of the coefficients at and at xy for the difference 
of Mar koff- Davenport forms for the MCRS-groups A and Asi,52- By the conditions of the 
lemma these coefficients are less then £1: 

62 - 5i 



2/3{/3 + 52) 



< £1 and 



a62 — l36i 



Hence we have 



[a 



< 



aS2 — pSi 



2(3{(3 + 62) - 2l3{(3 + 62) 
This gives us the estimate for ^2. 



2/3{/3 + 52) 



82 - 5i 



< £1. 



2(3{(3 + 52) 



<{l + m)ei. 
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For 5 1 we have 



\Si\<m 



, 2(l+|/3|)/3^ 

^ \a-0\-2e^\m+mr^ 



, 2(l+|/3|)/32 _ 2(l+|/3|+|a-/3|)/3^ ^ 



|a-/3|-2£i|/3|(l+|/3|)"l - |a-/3|-2£i|/3|(l+|/3|)' 

The proof is completed. □ 
Lemma 3.15. Let he a positive real number. Suppose \di\ < S2 and \d2\ < S2, then 

max (2, 2{\a\ + \a''-(5''\ + 2\a(3\ + 2\(3\e^ 
p(A AiA) < ^ i^wi^i , ^ -e2- 



+ £2) 

Proof. The statement of lemma follows directly form the estimate of the coefficients for 
the difference of Markoff-Davenport forms for the MCRS-groups A and As^^s^- CD 

Proof of Theorem 3.13. The remaining part of the proof almost completely repeats the 
end of the proof of Theorem 3.1, so we omit it here. □ 

3.2.2. Technique of calculation of best approximations in the hyperbolic case. Here we show 
a general technique of calculation of best approximations for an arbitrary MCRS-group 
A with eigenspaces y = (a ± Il3)x for real number a and positive real p. 

Proposition 3.16. Let a satisfy \a + < £3, then the following holds: 

\[a + 7/3) - a > . 

2p + £3 

Proof We have \{a + IB) - a\ = ^ m^A{i,a)\ > m^AM □ 

Procedure of best approximation calculation. 

1) . Find best Diophantine approximations of a and /3 using continued fractions in 
the square N x N. Suppose for a and /3 it are mi/ni, and 777.2/712, and the next best 
approximation are m'l/n'i, and m^/n^- 

2) . Consider the MCRS-group A with invariant lines |/ = (^±/^)a;. By Lemma 3.15 

we get an upper bound for p{A,A) (where 62 = ma.x{l / {nin[) , 1/(722722))). 

3) . Now having the estimate on discrepancy we use Lemma 3.14 to get estimates Ci 
and C2 for the best approximation of ^: |q; — ^| and |/9 — ^| respectively. 

4) . By Proposition 3.16 we write an estimate for |$^(l, ^ + /^) |. 

5) . Finally we compare the discrepancies for all MCRS-groups that satisfies the esti- 
mates obtained in 4). 

4. Simultaneous approximations in and MCRS-group approximations 

Theory of simultaneous approximation of a real vector by vectors with rational coeffi- 
cients can be considered as a special case of MCRS-group approximations similarly to the 

Diophantine case. In this section we study several examples of simultaneous approxima- 
tions in frames of MCRS-group approximations. The first example is an eigen-direction 
of a hyperbolic operator (see in Subsection 3.2) and the second is an eigen-direction of a 
nonhyperbolic operator (see in Subsection 3.3). 
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4.1. General construction. Let [a,6, c] be a vector in IR^. Consider the maximal com- 
mutative subgroup A[a, b, c] defined by three vectors 

{a,b,c), (0,1,7), (0,1,-7). 

The problem of approximation here is in approximation of the subgroup ^[a, 6, c] by 
A[a', 6', c'] for integer vectors (a', 6', c'). For this case we have: 

/ ^ r f + -i b o Co 1 2 1 2\ 

^A{a,b,c] Z/> ^) = ( 2aP~^ ^a^^^a^^~ 2^^ ~ 2^^ ) ' 



Therefore, 



lin ( r 



1- — — 


1 ^ 


c' 1 


\ a a' \ 


a 


a' \ ' 



b'^+c^ b'^+c'- 



--(l^ + i;i.|; + ^|.|Sj^ + ^|)) 



4.2. A ray of non-hyperbolic operator. Consider the non-hyperbolic algebraic ope- 
rator 

/oil 

S = 1 
\ 1 

This operator is in some sense the simplest non-hyperbolic operator we can have (see for 
more information [21]). 

Denote the eigenvalues of by ^i, ^2, and ^3 such that ^1 is real, ^2 and ^3 are complex 
conjugate. Notice also that 

161 > 161 = 161- 

We approximate the eigenspace corresponding to ^1. Let v^^ be the vector in this 
eigenspace having the first coordinate equal to 1. Note that 

^1 ^ 1.3247179573 and v^, ^ (1, .5698402911, .7548776662). 

The set of best approximations An with N < 10^ contains of 48 elements. These 
elements are of type S"'(l, 0, 0) where rii — 4, and for 2 < i < 48 we have rii — i + A. We 
conjecture that all the set of best approximations coincide with the set of points 5*^(1, 0, 0) 
where k — A, or k > 6, the approximation rate in this case is CN~^/'^. 

4.3. Two-dimensional golden ratio. Let us consider an algebraic operator 




This operator is usually called two-dimensional golden ratio. It is the simplest hyperbolic 
operator from many points of view, his two-dimensional continued fraction in the sense 
of Klein was studied in details by E. I. Korkina in [26] and [27]. 
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The group of all integer operators of GL(3, Z) commuting with G is generated by the 
following two operators: 

/ 1 1 1 \ /oil 
£;i = 1 1 and = 1 

\ 1 y \ 1 -1 

Note that G = Ef and E2 = {Ei — Id)~^, where Id is an identity operator. Operator Ei 
is a three-dimensional Fibonacci operator. 

Denote the eigenvalues of Ei by ^1, ^2, and ^3 in such a way that the following holds: 

161 > 161 > 161. 

Let us approximate the eigenspace corresponding to ^1. Denote by the vector of 
this eigenspace having the last coordinate equal to 1. Note that 

G ^ 2.2469796037 and v^^ ^ (2.2469796037, 1.8019377358, 1). 

The set of best approximations An with N < 10^ contains 40 elements. These elements 
are in the set 

^E^E^(1,0,0) m,neZy 

All the points of the sequence can be found from the next table. In the column c we 

get m = nic, n = Uc for the approximation E'^''E2''{1, 0, 0). 



i 


1 


2 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


20 


21 


22 
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1 


2 


3 


3 


4 


4 


5 


5 


6 


6 


6 


7 


7 


8 


8 


9 


9 


10 


10 


11 


11 
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1 


1 


2 


1 


2 


1 


3 


2 


3 


2 


1 


3 


2 


3 


2 


4 


3 


4 


3 


5 


4 



i 


23 


24 


25 


26 


27 


28 


29 


30 


31 


32 


33 


34 


35 


36 


37 


38 


39 


40 


41 


m 


11 


12 


12 


13 


13 


14 


14 


15 


15 


15 


16 


16 


17 


17 


18 


18 


19 


19 


19 


n 


3 


4 


3 


5 


4 


5 
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6 


5 


4 


5 


4 


6 


5 


6 


5 


7 


6 


5 



In addition to this table we have ^3 = (3, 2, 1) as best approximation. 

We conjecture that all the set of best approximations except A3 is contained in the set 
of all points of type £'{"£'2 (1, 0, 0), the approximation rate in this case is GN~^/'^. 
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